IMAGE PROCESSING APPARATUS, IMAGE PROCESSING METHOD 
AND A COMPUTER PROGRAM PRODUCT FOR JUDGING 
WHETHER IMAGE DATA INCLUDE SPECIFIC INFORMATION 
RELATED TO COPY PROTECTION 



BACKGROUND OF THE INVENTION 



Field of the Invention 

This invention relates to an image 
processing apparatus, an image processing method and 
a computer program product for judging whether image 
data include specific information related to copy 
protection . 

Description of the Related Art 

In connection with color copying machines, 
it has been considered to implement an image 
recognition processing function to prevent 
counterfeiting of a copy-prohibited object such as a 
banknote or valuable securities. One drawback of 
color copying machines is that they are expensive 
stand-alone devices. More recently, high quality 
copying has been attained using less expensive 
computers and computer peripheral apparatus such as 
a color scanner and a color printer, and image 



processing software to edit an input and output 
image. A need has therefore developed, using an 
image recognition processing function, to prevent 
counterfeiting of a banknote and valuable securities 
for an inexpensive color image processing system 
using a color scanner and printer. 

There are some known judging methods for 
judging whether an original is a copy-prohibited 
object or not. An original is judged based on a 
color spectrum distribution of image data (R, G, B 
data for each pixel) generated by scanning the 
original, and a comparison of the color spectrum 
distribution with copy-prohibited object data stored 
in a ROM, or a comparison of an image pattern of a 
part of the original (or the entire original) with a 
copy-prohibited object pattern stored in a ROM. The 
result of the judging is an evaluation value as to 
whether the original is a copy-prohibited object or 
not . 

It is recently possible to make a copy- 
prohibited object by using a technology called 
digital watermark. The copy-prohibited object is 
altered to include information indicating whether 
the object is a copy-prohibited object. The process 
of making the copy-prohibited object is as follows. 
First, second digital information (sub-information) 
is attached indicating a copy-prohibited object to 
digital image data as the first digital information 
(main- information) . Next, a printed document is 
made from the digital image data with its attached 
second information. Of course the second digital 



information indicating a copy-prohibited object can 
be detected from the digital image data with its 
attached second digital information, as a 
characteristic of the digital watermark. It is 
possible to detect the second digital information 
indicating a copy-prohibited object from newly- 
created image data which is created from the printed 
document by an image reading apparatus (e.g., a 
color scanner) . This technology is called digital 
watermark and is increasingly used for prohibiting 
illegal copying of printed material. 

In view of widespread use of computer 
peripherals to make color copier, a judging process 
chiefly made of software for a copy-prohibited 
object is preferable to a hardware one comprising 
many electrical circuits. Such a software process, 
however ,uses too much processing power and too long 
a time to judge whether an image is a copy- 
prohibited object or not and to process the image. 

SUMMARY OF THE INVENTION 

An object of the present invention is to 
address the above situation. 

One particular object of the present 
invention is to provide an image processing 
apparatus and method and a computer program product 
that can avoid unnecessary processing and can 
provide a faster judgment of whether or not an 
object is copy-prohibited faster. 



Another object of the present invention is 
to provide an image processing apparatus and method 
and a computer program product that have a new 
function not known before. 

According to one aspect, the present 
invention, which achieves these objectives, relates 
to image processing in which an image resolution of 
a input image data is compared to information of 
predetermined standard resolution and the image data 
is judged to determine whether it includes specific 
information related to copy protection, with judging 
being controlled not to work on the basis of the 
result of the comparing means. 

Because the control technique of the 
present invention controls not to work the judgment 
on the basis of the result of the comparing means, 
the control technique according to the invention 
provides an efficient judging processing, since no 
judgment is performed on low resolution image data 
which is not so prone to counterfeiting. 

The foregoing and still other objects, 
features and advantages of the present invention 
will become fully apparent from the following 
description to be taken in conjunction with the 
attached drawings . 



BRIEF DESCRIPTION OF THE DRAWINGS 



FIG . 1 is a diagram which shows the image 
processing apparatus of this suggestion. 



FIG. 2 is a diagram which shows one 
embodiment of a image processing system of the 
present invention. 

FIG. 3 is a block diagram that shows the 
main portion of FIG. 2. 

FIG. 4 is a flow chart which shows the 
process sequence by using the construction of FIG. 2 
and FIG. 3 . 

FIG. 5 is a flow chart which shows the 
process sequence of a third embodiment . 

FIG. 6 is a flow chart which shows a 
modification of the process sequence of FIG. 4. 

FIG. 7 is a flow chart which shows a 
modification of the process sequence of FIG. 4. 

FIG. 8 is a flow chart which shows a 
modification of the process sequence of FIG. 5. 

FIG. 9 is a flow chart which shows a 
modification of the process sequence of FIG. 5. 

FIG. 10 is a diagram which shows a six 
embodiment of an image processing system. 

FIG. 11 is a block diagram that shows the 
main portion of FIG. 10. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

FIG. 1 is a block diagram which shows an 
image processing apparatus of this suggestion. 

Input image data control means 110 
controls a resolution of an image which is read by 
image data source 12 0 as an image scanner. Image 
data generating means 13 0 generates image data of an 



image resolution which is controlled by input image 
data control means 110. Memory 140 stores the image 
data generated by image data generating means 130. 
Data attaching means 150, which is controlled by 
main control means 200 based on the image resolution 
controlled by input image data control means 110, 
attaches digital data to the image data stored in 
memory 140. Image character recognition means 160, 
which is controlled by main control means 200 based 
on the image resolution controlled by input image 
data control means 110, judges whether the image 
data stored in memory 14 0 belongs to a copy- 
prohibited object image. 

Recognition information output means 170 
outputs a recognition result of the image character 
recognition means 160. Recognition information 
receiving means 180 displays the recognition result 
on a display or the like, and receives the 
recognition result information and informs the image 
processing apparatus's user that an original based 
on said image data is a copy-prohibited object 
image. Image data output means 190 outputs 
sequentially an output image. 

Each function block in FIG. 1 works as the 
following description. Image data generating means 
130 generates image data of a resolution which is 
indicated from an indicating means (unshown) of input 
image data control means 110 and is based on a 
preset image on image data source 12 0 and an 
indication by an user of the image process 
apparatus. Information of the image resolution 



indicated by a user of the image process apparatus 
is output to main control means 2 00 at the same 
time. Main control means 200 control data 
attaching means 150 and image character recognition 
means 160 and recognition information output means 
170 based on the information of the image resolution 
output from input image data control means 110 . 

(The first embodiment) 

Information indicating a copy-prohibited 
object image is attached to an original by using a 
technology called digital watermark in one 
preferable embodiment of this invention. 

An original of the copy-prohibited object 
is formed by printing a printing object from image 
data to which is attached the information indicating 
a copy-prohibited object. The digital image data, 
with its attached information indicating the copy- 
prohibited object, is made by attaching second 
digital information indicating the copy-prohibited 
object to the first digital information which is a 
source of the printing object. The digital 
watermark is possible to be any kind of digital 
watermark , such as one attached to a specific 
frequency of image information as invisible 
information or visible information but difficult for 
human eyes to see like yellow dots. 

A inexpensive color scanner or printer is 
preferable to carry out a counterfeit prevention of 
a copy-prohibited object less expensive than a 
comparatively expensive color copying machine as 



stated above. It is effective answer to judge the 
copy-prohibited object by using a software process, 
but the software judging process has a problem 
related to a process speed. Accordingly, the 
invention checks the possibility that a printing 
image based on an original is used as a counterfeit, 
in accordance with image resolution. The 
possibility is degree of risk that someone mistakes 
the counterfeit for a genuine one. 

The following is a detailed explanation, 
which is made with reference to the drawings, of the 
preferred embodiments of this invention. FIG. 2 
shows one embodiment of an image processing system 
of the present invention. Image scanner 1 is an 
image input apparatus and a personal computer 2 
processes image data input by image scanner 1. Cable 
3 connects image scanner 1 and personal computer 2 
and communicates the image data. 

FIG. 3 is a block diagram that shows the 
main portion of FIG. 2. CPU 11 is a central 
processing unit and RAM 12 is random access memory 
and ROM 13 is read only memory. Display control 
unit 14 controls display 15 and operation input unit 
16 is a keyboard or a mouse. Connection I/O 17 is 
used for connecting operation input unit 16 to the 
image processing system. External memory unit 18 is 
a hard disk or a memory card etc. Connection I/O 19 
is used for connecting external memory unit 18 to 
the image processing system. Bus 22 is used for 
communication image data or another data. Image 
scanner 21 is the same as image scanner 1 in FIG. 2. 



Connection I/O 22 is used for receiving image data 
from image scanner 21 and sending control signals to 
image scanner 21. Interface unit 23 is a 
communication unit like a network. 

FIG. 4 is a flow chart which shows a 
process sequence based on performing a process of 
blocks of FIG. 2 and FIG. 3. A program which 
describes the process sequence of FIG. 4 is stored 
on ROM 13 in advance or on external memory unit 18 
and then the program is moved into RAM 12. CPU 11 
executes the program to execute the process of this 
embodiment by software processes . The program is 
preferably a part of a scanner driver. 

Reading image resolution, designated by 
image system user, is stored on RAM 12 in step 10. 
In step 20, CPU 11 judges whether the designated 
image resolution {Rin} is not as high as a 
predetermined first standard resolution {Tl}, e.g. 
100 dpi [dot/inch] . This process is the first 
judgment. In the case the designated image 
resolution {Rin} is not as high as the predetermined 
first standard resolution {Tl} , the process flows to 
step 40. On the other hand in the case the 
designated image resolution {Rin} is as high as the 
predetermined first standard resolution {Tl}, the 
process flows to step 30. As a result, a judgment 
which a scanned image is a copy-prohibited object 
image does not work when the scanned image's 
resolution is not as high as a predetermined 
resolution since an printout of the scanned image is 
useless as a counterfeit. It is fast to print an 
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image that image resolution is not as high as the 
first standard density since the judgment is not 
executed. 

In step 30, CPU 11 judges whether the 
designated image resolution {Rin} is not as high as 
the predetermined second standard resolution {T2}, 
e.g. 300 dpi [dot/inch] . This judgment is a second 
judgment. In the case the designated image 
resolution {Rin} is not as high as the predetermined 
second standard resolution {T2} 7 the process flows 
to step 41. On the other hand in the case the 
designated image resolution {Rin} is as high as the 
predetermined second standard resolution {Tl}, the 
process flows to step 60. It can be expected that a 
counterfeiter who scans a copy-prohibited object 
image designates high resolution scanning. 
Accordingly, judgment as to whether a scanned image 
is a copy-prohibited object image executes when the 
scanned image is high resolution. 

In step 4 0 or 41, CPU 11 judges the image 
data of image resolution is a low risk of 
counterfeiting and indicates, through the connection 
I/O 22, the color image scanner 21 scanning a 
original on the flatbed by user's designated image 
resolution. The image scanner scans the original. 
The image data based on the original is sent and 
stored on RAM 12 through the connection I/O 12. 
After step 40, the process of FIG. 4 flows to step 
90. After step 41, the process of FIG. 4 flows to 
step 50. 
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In step 50, the image resolution is not 
high enough and is not suitable for inputting a 
vivid copy-prohibited object, but CPU 11 takes 
measures to prevent a counterfeit of the copy- 
prohibited object by way of caution. Concretely, 
CPU 11 attaches the product's number of personal 
computer 2 or color image scanner 1 and the user ID 
information to the image stored on RAM 12 . The 
attached information is registered when a driver of 
the color image scanner 1 is installed. If the 
image stored on RAM 12 is printed or is output a 
external apparatus through a network, it is thus 
possible to identify the person or apparatus that 
scanned the copy-prohibited object image by using 
the attached information. The attachment is 
performed by the technology is called digital 
watermark. After step 50, the process of FIG. 4 
flows to step 90. 

In step 60, since there is a possibility 
of inputting of the copy-prohibited object image as 
a vivid image, CPU 11 judges the image data of the 
image resolution is high risk of counterfeiting and 
performs extraction of digital watermark attached to 
the copy-prohibited object image from the image 
stored on RAM 12. CPU 11 indicates, through 
connection I/O 22, color image scanner 21 scanning a 
original on the flatbed by lower image resolution 
than the user's designated one. Color image scanner 
21 scans the original by the lower image resolution. 
The image data generated by the scanning is sent to 
RAM 12 through the connection I/O 22. This scanning 
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is carried by using a well-known function of a color 
image scanner driver. After step 60, the process of 
FIG. 4 flows to step 70. 

In step 7 0-, CPU 11 judges whether the 
lower image data generated by the scanning is the 
copy-prohibited object image or not. In the case 
CPU 11 judges that the lower image data belongs to 
the copy-prohibited object image, the process flows 
to step 80. On the other hand in the case CPU 11 
judges that the lower image data is not a copy- 
prohibited object image, the next process is step 
42. Step 42 is the same as step 40 or 41, and the 
process flows thereafter to step 90. 

In Step 80, the lower image data generated 
by the scanning is output as a processed image. 
Concretely, the lower image data generated by the 
scanning is output 1) after converting color or 
changing image size, or/and 2) after attaching any 
symbol or figure as a processed image. The 
processed image is not equal to the scanned image 
data . 

It is easy to make the processed image 
from the image stored on RAM 12 by working a well- 
known image processing program module correspond to 
1) and 2) under CPU 11' s control. The processed 
image is output to external memory unit 18 as an 
image data file through the connection I/O 19. The 
process terminates when step 80 has finished. 

In step 90, the image data scanned in step 
4 2 is output to external memory unit 18 as a image 
file through the connection I/O 19, when CPU 11 
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judges the lower image data generated by the 
scanning is not a copy-prohibited object image. The 
process terminates when step 90 has finished. 

The original as a print document, which is 
made from the digital image data with attached 
information indicating a copy-prohibited object 
image as a digital watermark, is scanned by color 
image scanner 21. The judgment of the copy- 
prohibited object image in step 8 0 is performed by 
extracting the digital watermark from the scanned 
image data. 

In step 80, it is possible to select 
another process which the image data generated by 
the scanned image is not output at all. As a 
result, the copy-prohibited object image can not be 
input in the first place. Of course, it may be good 
to give warning of indicating the copy-prohibited 
object image is an original. The warning is 
displayed on the display 15 through display control 
unit 14 . The warning has the advantage to stop 
mischief and mistake a copy-prohibited object image 
for the original . 

It is possible to prevent a counterfeiter 
from reading a copy-prohibited object image by high 
image resolution. Additionally, a process speed of 
this embodiment's image processing system which 
judges a copy-prohibited object image by using 
software and CPU is faster because a judgment of the 
copy-prohibited object image is not performed for an 
image read with low image resolution. This 
embodiment's image processing system does not judge 
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an image read with middle range resolution because a 
possibility of reading copy-prohibited object image 
is not high enough, and then the middle range 
resolution image is attached with information. It 
is thus possible to stop the software judgment 
consuming much time. 

[Second embodiment] 

The judgment of a copy-prohibited object 
image, in step 70 of the first embodiment, is 
performed for photo electrical converted image data 
generated from a print object added information, 
using digital water mark, indicating the copy- 
prohibited object image. 

For the judgment of a copy-prohibited 
object image, in step 70, it is possible to replace 
another method. For example, an original is judged 
based on a color spectrum distribution based on 
image data (R,G,B data for each pixel) generated by 
scanning the original and a comparison of the color 
spectrum distribution with copy-prohibited object 
data stored in a ROM or a comparison of an image 
pattern of a part of the original (or the entire 
original) with a copy-prohibited object pattern 
stored in a ROM. The result of the judging is an 
evaluation value as to whether the original is a 
copy-prohibited object or not. An original is 
judged by comparing a color spectrum distribution 
based on image data (R,G,B data for each pixel) 
generated by scanning the original with a copy- 
prohibited object data stored a ROM or by comparing 



-15- 

an image pattern of a part of the original (or the 
entire original) with a copy-prohibited object 
pattern stored a ROM. The result of the comparing 
is a evaluation value which indicates whether the 
original is a copy-prohibited object image or not. 

In this case, the evaluation value 
(e.g., the sum of the absolute value of the comparing 
result or the correlation between the image data 
(pattern) and data (pattern) stored a ROM) is judged 
on the basis of a predetermined threshold. If the 
sum of the absolute value of the comparing result is 
not over the predetermined threshold, the original 
is judged as a copy-prohibited object image. If the 
sum of the absolute value of the comparing result is 
over the predetermined threshold, the original is 
not judged as a copy-prohibited object image. If the 
correlation is over the predetermined threshold, the 
original is judged as a copy-prohibited object 
image. If the correlation is over the predetermined 
threshold, the original is not judged as a copy- 
prohibited object image. 

[Third embodiment] 

In the first embodiment and second 
embodiment, if an original image is not judged as a 
copy-prohibited object image, the original image is 
output without information attached to the original 
image. It is possible to attach information in the 
original image in step 51, which is the same as step 
50, after step 42. A flowchart of this process is 
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FIG. 5. FIG. 5 and FIG. 3 are the same except step 
51. 

[Fourth embodiment] 

In step 3 0 of the first, second and third 
embodiment, if the user-designated image resolution 
is not as high as the predetermined second standard 
resolution, the specific data is attached to the 
image data in step 50. It is possible to replace 
step 50 with step 71, which is the same as step 70, 
or to perform both step 5 0 and step 71. 

FIG. 6 is a flowchart which performs the 
above-mentioned change to FIG. 4. In step 71 after 
reading an image in step 41, a judgment of a copy- 
prohibited object is performed. In the case CPU 11 
judges that the image is a copy-prohibited object 
image,, the process flows to step 80. On the other 
hand in the case CPU 11 judges that the image is not 
a copy-prohibited object image, the next process 
flows to step 90. The rest of the steps in FIG. 6 
are the same as FIG. 4. 

FIG. 7 is a flowchart which performs the 
alternate change mentioned above for Fig. 4. In 
step 71, after being attached with data in step 50, 
a judgment of a copy-prohibited object is performed 
like step 70. In the case CPU 11 judges that a read 
image is a copy-prohibited object image, the process 
flows to step 80. On the other hand in the case CPU 
11 judges that the image doesn't is not a copy- 
prohibited object image, the process flows to step 
90 . It is possible to reduce process speed without 
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reading the image by low resolution, because image 
resolution is somewhat lower in this case. The rest 
of the steps in FIG. 7 are the same as FIG. 4. 

FIG. 8 is a flowchart which performs the 
above-mentioned change to FIG. 5. In step 71 after 
reading an image in step 41, a judgment of a copy- 
prohibited object is performed. In the case CPU 11 
judges that the image is a copy-prohibited object 
image, the next process is step 80. On the other 
hand in the case CPU 11 judges that the image is not 
a copy-prohibited object image, the process flows to 
step 90. The rest of the steps in FIG. 8 are the 
same as FIG. 5. 

FIG. 9 is a flowchart which performs the 
above-mentioned change to FIG. 5. In step 71, after 
being attached with data in step 50, a judgment of a 
copy-prohibited object is performed like step 70. 
In the case CPU 11 judges that a read image is a 
copy-prohibited object image, the process flows to 
step 80. On the other hand in the case CPU 11 
judges that the image is not a copy-prohibited 
object image, the process flows to step 90. The 
rest of the steps in FIG. 9 are the same as FIG. 5. 

[Fifth embodiment] 

The above-mentioned process of attaching 
data or judging a copy-prohibited object is 
performed for color scanned image data on the basis 
of user-designated image resolution. The process is 
not only performed for the color scanned image data 
but also other input image data. The other image 



input data is input from interface unit 2 3 in FIG. 3 
as communication means like a network or a 
detachable storage medium (e.g., smart media, 
compact flash, magnetic optical disk) which is 
connected to a un- shown drive unit of the image 
process system in FIG. 3 and stores color image 
data. The attached information, in step 50, is the 
network address of the sender apparatus which send 
image data through interface unit 23 or the number 
of the detachable memory in the abovementioned case. 

The above-mentioned judging program of 
copy-prohibited object is included in a 
communication program (ex. Internet browser soft 
ware) or a program for obtaining image from a 
storage medium. 

CPU 11 controls the input image resolution 
information of stored image in step 10 in this case. 
Image data stored on the detachable memory being 
attached the un- shown drive unit is read through an 
I/O unit which is connected the drive unit of the 
detachable memory. The image resolution information 
in step 10 and the image data in step 40, 41 and 42 
may be input through an interface unit connected to 
a network like the Internet. 

[Sixth embodiment] 

Image data including the processed image 
data and the scanned image data is output as an 
image data file to external memory unit 18 (a hard 
disk of this image processing system) through the 
connection I/O 19. However, image data may be 
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output to a color printer or an external apparatus 
through network and an interface unit. In this case, 
attached information in step 50 is a product number 
or a network address of a send side apparatus or a 
receive side apparatus. In this embodiment, a copy- 
prohibited object judging program includes a program 
for using communication through network or printer 
driver . 

FIG. 10 indicates a example of a image 
processing system of this embodiment. Image scanner 
101 is an image input apparatus and a personal 
computer 102 processes image data and outputs 
processed image data to color printer 104 as a 
output apparatus . 

FIG. 11 is a block diagram that shows the 
main portion of FIG. 10. Connection I/O 125 
connects to an image output apparatus like a color 
printer. Other components of FIG. 11 are the same 
as FIG. 3. In this case, image output in step 80 
and 9 0 in FIGS. 4, 5, 6, 7, 8 and 9 are replaced 
with image output to a color printer 24 connected 
through I/O 25. Image data in step 80, 90 may be 
output through an interface unit connected to a 
network like the Internet. 

[Seventh embodiment] 

When the color printer outputs an object 
image in the sixth embodiment, there is attached 
information attached to the object image by using 
digital watermark method from step 50 and step 51. 
However, It is possible to attach information like 
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serial number in a printed image as unknown color 
information for an image processing system user. 

(Other embodiments) 

The object of the present invention can 
also be achieved by providing a storage medium 
storing program codes for performing the aforesaid 
processes to a system or an apparatus, reading the 
program codes with a computer (e.g., CPU, MPU) of 
the system or apparatus from the storage medium, 
then executing the program. 

In this case, the program codes read from 
the storage medium realize the functions according 
to the embodiments, and the storage medium storing 
the program codes constitutes the invention. 

Further, the storage medium, such as a 
floppy disk, a hard disk, an optical disk, a 
magneto-optical disk, CD-ROM, CD-R, a magnetic tape, 
a non-volatile type memory card, and ROM can be used 
for providing the program codes . 

Furthermore, besides aforesaid functions 
according to the above embodiments are realized by 
executing the program codes which are read by a 
computer, the present invention includes a case 
where an OS (Operating System) or the like working 
on the computer performs a part or entire processes 
in accordance with designations of the program codes 
and realizes functions according to the above 
embodiments . 

The image processing system judges a risk 
of a read image being used for a forgery on the 
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basis of a user's indicated image reading resolution 
and reduces a process for prohibiting forgery which 
is usually performed for every image even when there 
is little risk. 

As a result, a process of calculation by 
using a software for prohibiting forgery is 
efficient and it is possible to be faster than a 
process speed of the image process system totally. 



